Action decouple multi-tasking for micro-expression recognition

نویسندگان

چکیده

Micro-expressions are brief, involuntary facial movements that reveal genuine emotions. However, extracting and learning features from micro-expressions poses challenges due to their short duration low intensity. To address this problem, we propose the ADMME (Action Decouple Multi-tasking for Micro-Expression Recognition) method. In our model, adopt a pseudo-siamese network architecture leverage contrastive obtain better representation of micro-expression motion features. During model training, utilize focal loss handle class imbalance issue in datasets. Additionally, introduce an AU Unit) detection task, which provides new inductive bias detection, enhancing model’s generalization robustness. Through five-class classification experiments conducted on CASMEII SAMM datasets, achieve accuracy rates 86.34% 81.28%, with F1 scores 0.8635 0.8168, respectively. These results validate effectiveness method recognition tasks. Furthermore, each component approach through series ablation experiments.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Improving multi-tasking ability through action videogames.

The present study examined whether action videogames can improve multi-tasking in high workload environments. Two groups with no action videogame experience were pre-tested using the Multi-Attribute Task Battery (MATB). It consists of two primary tasks; tracking and fuel management, and two secondary tasks; systems monitoring and communication. One group served as a control group, while a secon...

متن کامل

Multi-task mid-level feature learning for micro-expression recognition

Due to the short duration and low intensity of micro-expressions, the recognition of micro-expression is still a challenging problem. In this paper, we develop a novel multi-task mid-level feature learning method to enhance the discrimination ability of extracted low-level features by learning a set of class-specific feature mappings, which would be used for generating our mid-level feature rep...

متن کامل

Multi-tasking for TinyOS

Tasks in TinyOS execute non-preemptively and run to completion, forcing programmers to keep individual tasks short and spread lengthy operations across multiple tasks – a major divergence from conventional programming paradigms. This report documents our attempt to incorporate multi-tasking into TinyOS and its subsequent effect on power consumption of “motes”. We succeeded in modifying the Tiny...

متن کامل

All for One: Multi-Modal, Multi-Tasking

We introduce Attention Teams, a unified framework for training multiple models end-to-end for multiple tasks. This paper explores banding together simple Gated Recurrent Units in teams coordinated by a high-level attention mechanism. The attention mechanism is operated by a GRU leader that determines how relevant the output of each GRU teammate is to the current input. This kind of coordination...

متن کامل

Multi-format Notifications for Multi-tasking

We studied people's perception of and response to a set of visual and auditory notifications issued in a multi-task environment. Primary findings show that participants' reactive preference ratings of notifications delivered in various contexts during experimentation appear to contradict their reflective, overall ratings of the notification formats when elicited independently of contextual info...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3301950